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Abstract 

We consider estimating a random vector from its noisy projections onto low-di- 
mensional subspaces constituting a fusion frame. A fusion frame is a collection of 
subspaces, for which the sum of the projection operators onto the subspaces is 
bounded below and above by constant multiples of the identity operator. We first 
determine the minimum mean-squared error (MSE) in linearly estimating the ran- 
dom vector of interest from its fusion frame projections, in the presence of white 
noise. We show that MSE assumes its minimum value when the fusion frame is tight. 
We then analyze the robustness of the constructed linear minimum MSE (LMMSE) 
estimator to erasures of the fusion frame subspaces. We prove that tight fusion 
frames consisting of equi-dimensional subspaces have maximum robustness (in the 
MSE sense) with respect to erasures of one subspace, and that the optimal sub- 
space dimension depends on signal-to-noise ratio (SNR). We also prove that tight 
fusion frames consisting of equi-dimensional subspaces with equal pairwise chordal 
distances are most robust with respect to two and more subspace erasures. We call 
such fusion frames equi-distance tight fusion frames, and prove that the chordal dis- 
tance between subspaces in such fusion frames meets the so-called simplex bound, 
and thereby establish connections between equi-distance tight fusion frames and op- 
timal Grassmannian packings. Finally, we present several examples for construction 
of equi-distance tight fusion frames. 
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1 Introduction 

The notion of a fusion frame (or frame of subspaces) was introduced by 
Casazza and Kutyniok in and further developed by Casazza et al. in |2|. 
A fusion frame for is a finite collection of subspaces {Wj}^^ in M*^ such 
that there exist constants < A < B < oo satisfying 

N 

^||xf < J2 llPi^f < for any x G M*^ 

i=l 

where Pi is the orthogonal projection onto Wj. Alternatively, {Wij^i is a 
fusion frame if and only if 

N 

AI<J2Pi<BI. (1) 

i=l 

The constants A and B are called (fusion) frame bounds. An important class 
of fusion frames are tight fusion frames, for which A and B can be chosen to 
be equal and Ylj^i Pi = AI. We note that the definition given in jT] and [2] 
for fusion frames apply to closed and weighted subspaces in any Hilbert space. 
However, since the scope of this paper is limited to non-weighted subspaces in 
M^^, the definition of a fusion frame is only presented for this case. 

A fusion frame can be viewed as a frame-like collection of low-dimensional 
subspaces. In frame theory, an input signal is represented by a collection of 
scalars, which measure the magnitudes of the projections of the signal onto 
frame vectors, whereas in fusion frame theory an input signal is represented by 
a collection of vectors, which are the projections of the signal onto the fusion 
frame subspaces. Similar to frames, fusion frames can be used to provide a 
redundant and non-unique representation of a signal. In fact, in many appli- 
cations, where data has to be processed in a distributed manner by combining 
several locally processed data vectors, fusion frames can provide a more natu- 
ral mathematical framework than frames. A few examples of such applications 
are as follows. 

Distributed sensing: In distributed sensing, typically a large number of inex- 
pensive sensors are deployed in an area to measure a physical quantity such 
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as temperature, sound, vibration, pressure, etc., or to keep an area under 
surveillance for target detection and tracking. Due to practical and economi- 
cal factors, such as low communication bandwidth, limited signal processing 
power, limited battery life, or the topology of the surveillance area, the sen- 
sors are typically deployed in clusters, where each cluster includes a unit with 
higher computational and transmission power for local data processing. Thus, 
a typical large sensor network can be viewed as a redundant collection of sub- 
networks forming a set of subspaces. The gathered subspace information is 
submitted to a central processing station for joint processing. Some references 
that consider fusion frames for distributed sensing are and [S]. 

Parallel Processing: If a frame system is simply too large to handle effectively 
(from the numerical stand point), we can divide it into multiple small sub- 
systems for simpler and parallel processing. By introducing redundancy, when 
splitting the large system, we can introduce robustness against errors due to 
failure of a subsystem. Fusion frames provide a natural framework for split- 
ting a large frame system into smaller subsystems and then recombining the 
subsystems. 

Packet encoding: In digital media transmission, information bearing source 
symbols are typically encoded into a number of packets and then transmit- 
ted over a communication network, e.g., the internet. The transmitted packet 
may be corrupted during the transmission or completely lost due to, for ex- 
ample, buffer overflows. By introducing redundancy in encoding the symbols, 
according to an error correcting scheme, we can increase the reliability of the 
communication scheme. Fusion frames, as redundant collections of subspaces, 
can be used to produce a redundant representation of a source symbol. In the 
simplest form, we can think of each low- dimensional projection as a packet 
that carries some new information about the symbol. At the destination the 
packets can be decoded jointly to recover the transmitted symbol. The use of 
fusion frames for packet encoding is considered in [B]. 

In this paper, we consider estimating a random vector from its noisy projec- 
tions onto low-dimensional subspaces constituting a fusion frame. As far as 
we know, optimal reconstruction of random vector signals from fusion frame 
measurements (or even frame measurements) has not been considered before, 
despite the fact that random vectors provide a natural way of modeling signals 
in many applications, including distributed sensing. 

The optimal reconstruction of a random signal is different from the canonical 
reconstruction of a deterministic signal in a fusion frame that is considered in 
[2]. The canonical reconstruction strategy of a deterministic signal x G 
from its fusion frame measurements involves using the fusion frame operator 
Sx = YliLi PjX, which is invertible and self- adjoint. The deterministic signal 
X can then be recovered from its measurements {Pjx}^^ as x = S~^Sx = 
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J2iLi S ^PjX. However, this strategy is not optimal in the MSE sense if x is a 
random vector. 

When X is random, the (hnear) strategy that achieves minimum MSE is linear 
minimum mean-squared error (LMMSE) estimation or Wiener filtering, which 
is well-known in the statistical signal processing literature (cf. [TJ Ch.8]). We 
use this strategy to estimate the random vector x - assuming that its covari- 
ance matrix Hxx = -E[xx^] is nonsingular and known (but otherwise arbi- 
trary) - from its noisy fusion frame projections. We determine the MSE in the 
LMMSE estimation of x and show that the MSE assumes its minimum value 
when the fusion frame is tight. Our analysis also clarifies the effect of additive 
white noise on signal estimation in fusion frames, which has not been studied 
before. 

We then analyze the robustness of LMMSE estimators to erasures of the fusion 
frame subspaces. Erasures of subspaces can occur due to many factors in 
practice. In the distributed sensing example, a subspace erasure can occur due 
to a faulty or out of battery cluster of sensors, or due to loss of data during 
the transmission of local subspace information to the central processor. In 
scenarios where one or more sensor clusters are believed to be out of range for 
measuring the signal, or blocked by obstacles, their corresponding subspaces 
can be discarded on purpose. In the parallel processing example, an erasure 
can occur when a local processor crashes. In the packet encoding example, an 
erasure can occur when buffers in the network overflow. 

Constructing frames that allow for robust reconstruction of a deterministic 
signal in the presence of frame element erasures has been considered by a 
number of authors. In [S], Goyal et al. show that a normalized frame is op- 
timally robust against noise and one erasure (erasure of one element of the 
frame) if the frame is tight. Some ideas concerning multiple erasures were also 
presented. The work of Casazza and Kovacevic [9] focuses mainly on designing 
frames, which maintain completeness under a particular number of erasures. 
Holmes and Paulsen pDj and Bodmann and Paulsen [11] study the robust- 
ness of frames under multiple erasures and show that maximal robustness 
with respect to the worst-case (maximum) Euclidean reconstruction error is 
achieved when the frame elements are equi-angular. The connection between 
equi-angular frames and equi-angular lines has also been explored by Strohmer 
and Heath in [12], where the so-called Grassmannian frames are introduced. 

There are also a few papers that consider the construction of fusion frames 
for robust reconstruction of deterministic signals in the presence of subspace 
erasures. The main result in this context is due to Bodmann who shows 
that a tight fusion frame is optimally robust against one subspace erasure if 
the dimensions of the subspaces are equal. He also proves that a tight fusion 
frame is optimally robust against multiple erasures if the subspaces satisfy the 
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so-called equi-isoclinic condition. The performance measure considered in [6] is 
the worst-case (maximum) Euclidean reconstruction error. The equi-isoclinic 
condition requires all pairs of subspaces to have the same set of principal an- 
gles. This condition is very restrictive and there are only a few known examples 
of fusion frames that satisfy this condition. The single erasure case discussed 
in [6] has also been studied by Casazza and Kutyniok in [13]. We emphasize 
that all the above work on robustness to erasures in frames and fusion frames 
deals with the case where the signal of interest is deterministic. 

In this paper, we analyze the effect of subspace erasures on the performance 
of LMMSE estimators. We determine how the MSE of an LMMSE estimator, 
constructed based on the second-order statistics of the data in the absence of 
erasures, is affected by erasures. We limit our analysis to the case where the 
signal covariance matrix TL^x is of the form R^.^. = cr^I. The case of a general 
Hxx is more involved and is outside the scope of this paper. 

We prove that maximum robustness against one subspace erasure is achieved 
when the fusion frame is tight and all subspaces have equal dimensions where 
the optimal dimension depends on SNR. We also prove that a tight fusion 
frame consisting of equi- dimensional subspaces with equal pairwise chordal 
distances is maximally robust with respect to two and more subspace era- 
sures. We call such fusion frames equi-distance tight fusion frames. We prove 
that the pairwise chordal distances between the subspaces in equi-distance 
tight fusion frames meet the so-called simplex bound, and thereby establish an 
intriguing connection between the construction of such fusion frames and op- 
timal Grassmannian packings (cf. the excellent survey by Conway et al. |14j). 
This connection shows that optimal Grassmannian packings are fundamental 
for signal processing applications where low- dimensional projections are used 
for robust dimension reduction. 

The paper is organized as follows. In Section [21 we derive the MSE in LMMSE 
estimation of a random vector from its noisy fusion frame projections. In 
Section [3], we analyze the robustness of LMMSE estimators to erasures of 
fusion frame subspaces and derive conditions for the construction of maximally 
robust fusion frames. Section H] establishes a connection between equi-distance 
tight fusion frames and optimal Grassmannian packings. In Section \5[ we give 
several examples for the construction of equi-distance tight fusion frames. 
Conclusions are drawn in Section [61 



2 LMMSE Estimation from Fusion Frame Measurements 

Let X G R^^ be a zero-mean random vector with covariance matrix E\x.x ] = 
Tixxj which we wish to estimate from A*" noisy measurement vectors in a fusion 



5 



frame {Wj}^i, with bounds A < B, in the presence of noise. In other words, 
we wish to estimate x from its noisy projections onto the subspaces {Wj}^i. 
We take the dimension of the ith fusion frame subspace Wj, i = 1,2, . . . , N to 
be rrii. 



Let Zj G M^^, i = 1, . . . , N he the measurement vectors corresponding to 
{y^i}iLi- The measurement model for the ith subspace Wi, i = I, N is of 
the form 



Zj — PjX -|- Ilj, 

where Pj G R^^^*^ is the orthogonal projection matrix onto the mj-dimensio- 
nal subspace Wi, and rii G M*^ is the corresponding noise vector. Assume that 
the noise vectors for different subspaces are mutually uncorrelated, and that 
each noise vector is white with covariance matrix E[ninJ] = cr^I, i = 1, . . . , N. 
Further, assume that the signal vector x and the noise vectors Ui, i = 1, . . . , N 
are uncorrelated. 



Further, define the composite measurement vector z G 
posite projection matrix P G 



iNMxM 



as z 



and the com- 
z^)"^ and 

P = (Pf P^ ■ ■ ■ P%)'^- Then, the composite covariance matrix between x 
and z can be written as 



E 




x^ z^ 



P-x'a; -R-zz 



z 



!,{N+l)Mx{N+l)M 



where 



R^, = E[xz^ ] = R,.,.P^ = R,, Pi 



is the M X NM cross-covariance matrix between x and z, H^x = R^L; 



Rz 



E[zz 



PR^^P^ + all 



Rzz ( P'J 



• P^ ) + <I 



is the NM x A^M composite measurement covariance matrix. 



We wish to minimize the MSE in linearly estimating x from z. The linear MSE 
minimizer is known to be the Wiener filter or the LMMSE filter F = H^z^zzy 
which estimates x by x = Fz, e.g., see [7|. The error covariance matrix Rge in 
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this estimation is given by 



Ree = E[ee^] = E (x - Fz)(x - Fz 



n ' 

where the last equahty follows from the matrix inversion lemma (Sherman- 
Morrison- Woodbury formula) ITS', p. 50]. 

The MSE is obtained by taking the trace of Rge- Let 0j, i = 1, 2, . . . , M be 
the zth eigenvalue of R"^^ -|- (l/cr^)P^P and assume 0i > 02 > • ■ ■ > <^m > 0. 
Then, the MSE is 

M 1 

MSE = tT[R,,] = J2-. 

Let < Ai < A2 < ■ • ■ < Xm be the eigenvalues of Hxx- Then, from ([T]), it 
follows that 

1 A IB 

Ai 0„ A, 0„ 



or alternatively 



< — < 



A, + A,: + al 



Therefore, we have the following lower and upper bounds for the MSE: 

Ml / M 1 \ A/ 1 

i=l \^ al V i=l Vt) i=l A, + al 

The lower bound is achieved when the fusion frame is tight. That is, when 
A = B and 

N 

Y.^i = A\. (3) 
Taking the trace from both sides of ([3]) yields the bound A as 

1 ^ 

^ = TTy"'^^ (4) 



Thus, the MSE is given by 



M 2\ 

MSE = Y: (5) 



=1 
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Remark 2.1 When Hxx = (^"^i, the MSE expression in ([5]) reduces to 

MSE = M^M . (6) 

1=1 



3 Robustness to Subspace Erasures 



We now consider the case where subspace erasures occur, that is when mea- 
surement vectors from one or more subspaces are lost or discarded. We wish 
to determine the MSE when the LMMSE fiher F, which is calculated based 
on the full composite covariance matrix in ([2]), is applied to the composite 
measurement vector with erasures. We do not wish to recalculate the LMMSE 
filter every time an erasure occurs. Recalculating the LMMSE filter requires 
calculating the inverse of the composite covariance matrix of the remaining 
measurement vectors, which is intractable from a computational standpoint. 

In this section, we show how the subspaces in the fusion frame {Wj}^^ must 
be selected so that the MSE is minimized under subspace erasures. In our 
analysis we assume that {Wi\f^i is tight with bound A given by (jl]). For the 
sake of simplicity, we limit our analysis to the case where the signal covariance 
matrix is R^.^. = cr^I. The case where R^^a; is a general positive definite matrix 
is more involved and is outside the scope of this paper. 

Let S C {1, 2, ... , A^} be the set of indices corresponding to the erased sub- 
spaces. Then, the composite measurement vector with erasures z G R^^^ may 
be expressed as 

z = (I-E)z, 

where E is an NM x NM block-diagonal erasure matrix whose iih M x M 
diagonal block is a zero matrix, if z ^ S, or an identity matrix, if i G S. In other 
words, in z the measurement vectors associated with the erased subspaces are 
set to zero. 

The estimate of x is given by x = Fz, where F = H^z^z} is the (no-erasure) 
LMMSE filter. The error covariance matrix Ree for this estimate is given by 



Ree — E 



X — x)(x — x)"^ 
E [(x - F(I - E)z)(x - F(I - E)z)^" 

RxX — ^XZ^zzC^ ~ E)R2X — Rzz(I — E)"^R^j,"'"R2 
+ ^XZ^zzC^ " E)R22(I — E)^R~/R22:. 



We can rewrite Ree as 

R'ee -^ee ~t~ R'e 
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where Ree = R^x — Rx^R^iRzx is the no-erasure error covariance matrix, and 

Ree = RizRz/ER^^E^R^^^R^a; 

is the extra covariance matrix due to erasures. The MSE is given by 



MSE = ti[Ree] = MSEo + MSE, 
where MSEq = tr[Ree] is the no-erasure MSE in ((61) and 

MSE = tr[Ree] 
= tr[Ra;2R^^"^ER22E'^R2^"'"R2a;] 

= tr[a^P^(a^PP^ + all)-'E{alPP^ + a^I)E^(a^PP^ + aliy'P] 

is the extra MSE due to erasures. 

From the matrix inversion lemma [15^ P-50], we have 

= ^I-^ ^2 pp^^ (7) 

where the second equahty follows by using P-^P = Yl,f=i Pj = ^I- 



Using ([7j), we can simplify the expression for MSE to 



MSE = tr[Ree] = a''tr[P'''E((T^PP^ + (t^I)EP 



a^tr 



,ies / Vies 



(8) 



where a = al/{alA + cr'^). The last equality in ([H]) follows by considering the 
action of the erasure matrix E. 

We now show how the subspaces in the fusion frame {Wj}^i must be con- 
structed so that the total MSE is minimized for a given number of erasures. 
We consider three scenarios: one subspace erasure, two subspace erasures, and 
more than two subspace erasures. 
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3.1 One Subspace Erasure 



If only one of the subspaces, say the ith subspace, is erased, then MSB is 
given by 



MSB = MSBq + MSB 

= MSBo + tT[a\al + aDPi] 

Mala' , atial + a' 



2N +^-^^tV^-^' (9) 

where mi = tr[Pj] is the dimension of the ith subspace Wj. 

The erasure can occur for any of the subspaces. Thus, we have to choose 
rrii = m for all i = 1,...,N so that any one-erasure results in the same 
amount of performance degradation. This reduces the MSE expression (Q to 

j^g^ ^ Malal ^ al{al + al)m 



{Nmal/M + al) {Nmal/M + al) 



As a function of m, MSB = MSB{m) has a maximum at m = m, where 

~ M (iV - l)or4 _ al^l 

N{{N + l)al + al){l-2aiy 

The MSE is monotonically increasing for m < m and monotonically decreas- 
ing for m > m. The smallest value m can take under the constraint that 
the set of m-dimensional subspace {Wj}f£]^ remains a tight fusion frame is 
"^min = \M/N], where [■] denotes integer ceiling. We take the largest value 
m can take to be rrimax < M. The maximum allowable dimension rrimax is 
determined by practical considerations. In the distributed sensing problem it 
is the maximum number of sensors we can deploy in a cluster. In the paral- 
lel processing problem it is determined by the maximum computational load 
that the local processors can handle, and in the packet encoding problem it 
corresponds to the maximum amount of new information (minimum amount 
of redundancy) we can include in a packet, while achieving an error correction 
goal. 

We have the following theorem. 

Theorem 3.1 The MSE due to the erasure of one subspace is minimized when 
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all subspaces in {yVi}^i have equal dimension m = m* , where 

m* = < ifrrimin < fn < rrimax and MSE{m„,in) < MSE{m„,ax), 

mmax, otherwise. 

3.2 Two Subspace Erasures 

When two subspaces, say the ith subspace and the jth subspace, are erased 
or discarded, the total MSE is given by 

MSE = MSEo + USE 

= MSEo + ahilaliP, + Pjf + al{P, + Pj)]. 

We take the dimension of all subspaces to be equal to a given m in order to fix 
the performance against one subspace erasures. This fixes MSEq and reduces 
the minimization of MSE to minimizing the extra MSE, which is given by 

IISE = labial + cr^)m + 2aV^tr[PiPj]. 



To minimize MSE we have to choose Wj and Wj, so that tr[PjPj] is mini- 
mized. Since Pj and P^ are orthogonal projection matrices onto Wj and Wj, 
the eigenvalues of P^Pj are squares of the cosines of the principal angles 6e{i,j), 
i = 1, . . . , M between Wj and Wj. Therefore, 

AI 

tT[PiP,] = Y.cos^e,it,j) = M-dlit,j), (10) 

e=i 

where 

/ M 

dc{i,j) = X!sin^^K^>j) 
\i=i 

is known as the chordal distance [13] between Wj and Wj. 

Thus, we need to maximize the chordal distance dc{i,j). Since this has to be 
done for any two subspace erasures, i.e., for any pair (^, j), i 7^ j, we have to 
construct the subspaces {Wj}^]^ so that any such pair has maximum chordal 
distance. 

In Section HI we will prove that the subspaces in a fusion frame consisting 
of equi-dimensional and equi-distance (equi-chordal distance) subspaces have 
maximal chordal distance if and only if the fusion frame is tight. We call 
such a fusion frame an equi-distance tight fusion frame and the subspaces 
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corresponding to it maximal equi-distance subspaces. We note that maximal 
equi-distance does not mean that the principal angles between any pair of 
subspaces must be equal. Therefore, this is a more relaxed requirement than 
the equi-isoclinic condition in [B]. 

We have the following theorem. 

Theorem 3.2 The MSE due to two subspace erasures is minimized when the 
m-dimensional subspaces in the tight fusion frame are maximal equi- 

distance subspaces. 

We defer the construction of maximal equi-distance subspaces to Section HJ 
where we explain the connection between this construction and the problem 
of optimal packing of planes in a Grassmannian space [TBP^ . 



3.3 More Than Two Subspace Erasures 



We now consider the case where more than two subspaces are erased or dis- 
carded. Let the subspaces {Wj}^^ have equal dimension m > [M/iV] and 
equal pairwise chordal distance dc, so as to fix the performance against one- 
and two-erasures. Then, MSE can be written as 



MSE = ahr 



■ a 



l){M-dl). 



Similar to the two-erasure case, MSE is minimized when d^ takes its maximum 
value. Thus, we have the following theorem. 



Theorem 3.3 The MSE due to k erasures, 3 < k < N is minimized when 
the m-dimensional subspaces in the tight fusion frame {Wi}fLi are maximal 
equi-distance subspaces. 



4 Connections between Tight Fusion Frames and Optimal Packings 



In this section, we show that tight fusion frames that consist of equi-dimen- 
sional and equi-distance subspaces are closely related to optimal packings of 
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subspaces. We start by reviewing the classical packing problem for subspaces 
[T61IT1]. 



Classical Packing Problem. For given m, M, N, find a set of m-dimensional 
subspaces {yVi}^i in R^^ such that mini^Lj dc{i, j) is as large as possible. In 
this case we call {Wi}^^ an optimal packing. 

This problem was reformulated by Conway et al. in [14j by describing m- 
dimensional subspaces in as points on a sphere of radius |(M-l)(M + 2). 
This usually provides a lower- dimensional representation than the Pliicker 
embedding. This idea was then used to prove the optimality of many new 
packings by employing results from sphere packing theory such as Rankin 
bounds for spherical codes. In what follows, we briefly describe the embed- 
ding of the Grassmannian manifold G{m, M) of m-dimensional subspaces of 
M}'^ , as it was described in [13]. The basic idea is to identify an m-dimensional 
subspace W with the traceless part of the projection matrix Qi associated 
with W, i.e., with Qi = Qi — -^I. This yields an isometric embedding of 

G{m,M) into the sphere of radius \J~^^^^ in rI(*^~^)(*^+2), where the dis- 
tance measure is the chordal distance between two projections. The chordal 
distance c?c(Qi, Q2) between two projection matrices Qi and Q2 is given by 
(ic(Qi, Q2) = -^IIQi — Q2II2, and is equal to times the straight-line distance 
between the projection matrices. This is the reason that (ic(Qi5Q2) is called 
chordal distance. Conway et al. [T^ deduced from this particular embedding 
the following result. 

Theorem 4.1 ^14j Each packing of m-dimensional subspaces {Wi}^^i in R^^ 
satisfies 

,n, , m(M~m) N 
dl{i,j) < ^ „^ ^— — -, i,j = l,...,N. 



The upper bound is referred to as the simplex bound. The above theorem 
implies that if the pairwise chordal distances between a set of m-dimensional 
subspaces of meet the simplex bound those subspaces form an optimal 
packing, as the minimum of chordal distances cannot grow any further. 

We now establish a connection between tight fusion frames and optimal pack- 
ings. 



4-1 Equi- Dimensional Subspaces 



Consider a tight fusion frame {}Vi}f^i, with bound A, consisting of N m- 
dimensional subspaces that do not necessarily have equal pairwise chordal 
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distances. Since {yVi}fLi is tight, we have 

N 

AI = Y.P. (11) 

i=l 

On the one hand, we can apply the trace and employ the fact that tr[Pj] = m 
for each i, to obtain 

AM = Nm. (12) 
On the other hand, we can multiply flTTl) from left by Pj to get 

N 

{A-i)p,= y: p.p., J = l,...,N. 

We can then take the trace, employ the fact that tr[Pj] = m for each j, and 
use ffTUl) . to obtain 

N N 

(A-l)m= tr[P,P,] = (iV-l)m- ^ dl{i,j). (13) 

Equations (fT2!) and (fT3l) together prove the following result concerning the 
value of the fusion frame bound. 

Proposition 4.2 A tight fusion frame {yVi}^i with bound A and m-dimen- 
sional subspaces satisfies 

M . f - , . m ' ' ' 



4- .2 Equi- Dimensional and Equi- Distance Subspaces 



We now turn our attention to tight fusion frames {Wj}^]^ consisting of equi- 
dimensional and equi-distance subspaces, where the common dimension is m 
and the common chordal distance is dc- From Proposition 14. 2^ it follows that 



Thus, dl is given by 



M ^ 'm 



2 _ m(M - m) 



M N-V ^ ' 

which shows that (i^ precisely equals the simplex bound. 

Next we will study whether this condition is sufficient. That is, we wish to 
know whether a fusion frame consisting of equi-dimensional subspaces whose 
pairwise chordal distances are equal to the simplex bound is necessarily tight. 
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Consider a fusion frame {Wi}^i, consisting of m-dimensional subspaces 
with pairwise chordal distances dc equal to the simplex bound. Let tti, . . . , ttm 
be the eigenvalues of P-'^P = Yh=i Pj- Since {Wi}^i is a fusion frame for M^, 
we have vr^ > 0, £ = 1, 2, . . . , M, and the sum of vr^'s is given by 

M N 

J2^i = tr[P^P] = tr[P.] = Nm. (15) 
e=i i=i 

The sum of vrf 's can be written as 



M 

E^I = tr[PWP] 

N N 

= EEtr[P.P,] 

i=i j=i 

N N N 

= E E tr[P,P,]+Etr[P.] 

i=l j=l,j^i i=l 

= N{N ~ l){m - dl) + Nm, 

where the last equality follows from (fTOj) . Inserting the value of the simplex 
bound, we obtain 

To conclude that ( fTSi) together with ( |T6i) implies tightness of the fusion frame, 
we consider the problem of minimizing the function Y^iLi 7r| under the con- 
straint that Hi, ... , 71m is a sequence of nonnegative values which sum up to 
Z^Hi '^e = Nm. Using the method of Lagrange multipliers, we see that the 
minimum is achieved when all vr^'s are equal to Nm/M. This implies that 
f[T^ and fll6p can be simultaneously satisfied only when 

Nm 

From this relation, it follows that {Wi}^]^ is a tight fusion frame. Therefore, 
we have the following theorem. 

Theorem 4.3 Let {}Vi}^i be a fusion frame of m-dimensional subspaces with 
equal pairwise chordal distances dc- Then the fusion frame is tight if and only 
if dc equals the simplex bound. 

An immediate consequence of Theorem 14.31 is as follows. 

Corollary 4.4 Equi-distance tight fusion frames are optimal Grassmannian 
packings. 



15 



5 Construction of Equi-Distance Tight Fusion Frames 



In this section we present a few examples to illustrate the richness, but also 
the difficulty of constructing fusion frames with special properties such as 
tightness, equi- dimension, and equi- distance. The optimal packing of planes 
in the Grassmannian space G{m, M) is a difficult mathematical problem, the 
solution to which is known only for special values of N,m, and M. In fact, even 
optimal packing of lines (m = 1) or equivalently constructing equi-angular 
lines is a deep mathematical problem. The reader is referred to [12] for a review 
of problems which are equivalent to the construction of equi-angular lines. 
For the construction of optimal packings with higher-dimensional subspaces 
we refer the reader to [1^1[T6l[T 7j. We would also like to draw the reader's 
attention to N. J. Sloane's webpage [18], which includes many examples of 
Grassmannian packings. 

Example 5.1 As our ffist example for construction of equi-distance tight 
fusion frames, we use a result obtained by Calderbank et al. [17j for construc- 
tion of optimal packings. The procedure is as follows. Choose p to be a prime 
which is either 3 or congruent to —1 modulo 8. Then there exists an explicit 
construction which produces a tight fusion frame {Wjjfif]^^'*'^^ in with 

TJii = and a„ = — tor all ? = 1, . . . , , 

2 ' 4(p + 2) ,J , , 2 ' 

where denotes the dimension of the ith subspace. From Proposition 14.21 it 
follows that the bound of this fusion frame equals 



As a particular example of this construction we briefly outline the equi- 
distance tight fusion frame we obtain for p = 7. For this, let Q = {qi}f^i = 
{1,2,4} denote the nonzero quadratic residues modulo 7, and R = {3,5,6} 
the nonresidues. Further, let H be a 4 x 4 Hadamard matrix, e.g.. 



H 



/ 1 1 1 l\ 
-11-11 
-1-1 1 1 
1 -1-11 



Finally, we denote the coordinate vectors in by ej, < i < 6, and set 
C = \/2 and k = 3. Then we deflne 4 three-dimensional planes Lj, 1 < j < 4 
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to be spanned by the vectors 



e^^ + CHijekq^, 1 < i < 3. 

For each L^, we obtain 6 further planes by applying the cyclic permutation 
of coordinates t— > 6(4+1) mod 7- This yields 28 three-dimensional planes in 
MJ, which form a tight fusion frame with bound 12. Moreover, the chordal 
distance between each pair of them equals c?^ = 

This construction is based on employing properties of special groups, in this 
case the Clifford group. We remark that this is closely related with the con- 
struction of error-correcting codes. 

Example 5.2 This example considers the construction of an equi-distance 
tight fusion frame for a dimension not covered by Example 15.11 by employing 
the theory of Eisenstein integers. More precisely, the subspaces will be gener- 
ated by the minimal elements of a special lattice. For this, we let S = {a + ub : 
a,b & denote the Eisenstein integers, where u = is a complex root 

of unity. The three-dimensional complex lattice Eq over S is then defined by 
its generator matrix 

^ ^ 

1 -1 
^1 0-1^ 

It can be shown that the minimal norm of a non-zero element in i?g is |. Out 
of the set of minimal elements, we now select the following nine: 

(1,-1,0), (1,0,-1), (0,1,-1), (0^,-1,0), 

(0,0;, -1), (-1,0,0;), (o;,0,-l), (-l,o;,0), (0,-1,.;). 

Multiplied by the 6th roots of unity, this yield 9 planes in C'^. Using the 
canonical mapping of C'^ onto M®, e.g., (cj,— 1,0) t-^ (— |, — 1, 0, 0, 0), we 
obtain 9 two-dimensional planes in R^. 

In this example all principle angles between each pair of planes are in fact 
equal to |. In particular, the chordal distance is = |, which can easily be 
seen to satisfy the simplex bound (cf. f[T^ ). By Theorem 14.31 it now follows 
that the fusion frame consisting of these planes is tight, and Proposition 14.21 
shows that the frame bound equals 3. 

Example 5.3 The third example explores the construction of fusion frames 
in by employing a similar strategy as in Example 15. 2[ However, with this 
example we wish to illustrate the need to be particularly meticulous when 
generating a fusion frame from minimal vectors of a particular lattice. In fact 
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by using a similar approach, wc will generate a tight fusion frame with equi- 
dimensional subspaces, but not equi-distance subspaces, although with a very 
distinct set of chordal distances. 

For our analysis, we choose the lattice 

E8^{{xi,...,xs) : (xi eZyi <i <8 or Xi eZ+l^l <i <8) 

and Eti^i e 2Z} , 

which is again a lattice over the Eisenstein integers £ — {a + cub : a,b & Z}, 
CO — ~^+^^ . Before studying the minimal vectors in this lattice, we consider 
the complex root of unity u = which was employed in the construction 

of S. We first express uj in quaternions, which gives uj = |(— 1 + « + J + A;). 
Next we define a matrix H by choosing as row vectors the coefficients of co, 
icu, jcu, and kcu, i.e., 

-11 1 1 ^ 
-1 -1 -1 1 
-1 1 -1 -1 
-1 -1 1 -Ij 
Form this, we build an 8 x 8-matrix by setting 

Realizing that this matrix satisfies + O + I = 0, we can conclude that 
scaling a vector v e £^8 by an Eisenstein integer a + cub can be rewritten as 

(a + cub)\ — av + bQ\. 

Now we are equipped to generate subspaces by minimal vectors, whose norm 
can be computed to equal 2. The lattice Es has 240 minimal vectors, which 
we assign to planes in the following way. We first consider the four minimal 
vectors 

(1,-1,0,0,0,0,0,0), (1,0,-1,0,0,0,0,0), 
(1,0,0,-1,0,0,0,0), (0,1,-1,0,0,0,0,0) 
and multiply each of them with 

I, -I, n, -n, I + n, and -1-12. (17) 

This procedure generates four sets of six minimal vectors, where each set 
generates a two-dimensional plane in IR^. Noticing that this construction only 



H 
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takes all minimal vectors which are of the form (xi, 0:2, X3, 0:4, 0, 0, 0, 0) into 
account, we can clearly use the same idea to group all minimal vectors of 
the form (0, 0, 0, 0, X5, Xe, Xy, Xg). Summarizing, this construction provides us 
with 8 two-dimensional planes in which we denote by Wi, . . . , Wg. Next 
we consider minimal vectors [xi, . . . ,xs), which have one coordinate out of 
xi,X2,X3,X4 and one coordinate out of X5,xq,X7,xs equal to —1 or 1, the 
others being equal to zero. Again we multiply these vectors by the factors 
given in f|T7|) . We can easily see that this procedure generates another 32 
two-dimensional planes in M.^, denoted by Wg, . . . , W40. 

Although this construction seems similar to the one on Example 15.21 we found 
it surprising to see that in fact {>Vi}|£]^ does constitute an equi- dimension tight 
fusion frame, however the subspaces are not equi-distance. The fusion frame 
bound can be derived from Proposition 14.21 and equals 10. Most interestingly, 
the structure of the chordal distances is rather distinct. In fact, it can be 
computed that the chordal distance between each pair is either = 2 - 
which means that they are orthogonal - or c?^ = |. 



6 Conclusions 

We considered the linear estimation of a random vector from its noisy projec- 
tions onto low- dimensional subspaces constituting a fusion frame. We proved 
that - in the presence of white noise - the MSE in such an estimation is mini- 
mal when the fusion frame is tight. We analyzed the effect of subspace erasures 
on the performance of LMMSE estimators. We proved that maximum robust- 
ness against one subspace erasures is achieved when the fusion frame is tight 
and all subspaces have equal dimensions, where the optimal dimension depends 
on the SNR. We also proved that equi-distance tight fusion frames are maxi- 
mally robust against two and more than two subspace erasures. In addition we 
proved that equi-distance tight fusion frames are in fact optimal Grassman- 
nian packings, and thereby showed that optimal Grassmannian packings are 
fundamental for signal processing applications where low-dimensional projec- 
tions are used for robust dimension reduction. We presented a few examples 
for the construction of equi-distance tight fusion frames and illustrated the 
interesting and sometimes challenging nature of such constructions. 
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